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AH S TKACH 

Recognit ional  capacity  is  needed  in  order  to  perform  tasks: 
a  recognition  of  when  procedures  apply,  further,  recognit ional  capacity 
cannot  t>c  replaced  by  higher-level  procedures.  This  creates  an 
insurmountable  harrier  for  qui debooks  that  attempt  to  provide  step-by- 
step  procedural  accounts  of  task  performance.  User  guides  will  be  most 
successful  when  they  attempt  to  show  novices  how  to  perform  procedural 
tasks.  However,  step-by-step  user  guide?  will  he  least  successful  when 
applied  to  task::  involving  recognit ional  capacity,  with  the  goal  of 
developing  high  levels  of  proficiency.  The  information  gathered  will 
be  voluminous  and  difficult  to  present,  but  will  also  be  criticized 
as  insufficient.  It  is  suggested  that  the  way  to  overcome  the  barrier 
presented  by  recognit ional  capacity  is  by  apprunehing  it  directly, 
perhaps  as  a  type  of  analogical  inference,  rattier  than  by  trying  to 
decompose  it  into  more  procedures. 


? 

USI  K  (MIDIS:  M>MI  I  HI  OKI  I  ll'AI  till  I  PI  I  IMS  I  UK  I  HI  IK  US! 

The  object  ive  of  this  paper  is  to  explore  some  of  the 
theoretical  1  i  in  i  t  .it  ions  of  user  guides.  Spec  it  deal  ly ,  I  will  t  r>  to 
show  that  step  by- step  approaches  oannot  ho  followed  for  t  ho  performance 
of  certain  typos  of  lash;;  and  are  not  us.oful  for  des.or ibing  high  levels 
of  prof ieieney. 

User  guides  oan  r.orve  a  variety  ol  function;;,  they  can  describe 
character  ir.t  irs  of  equipment,  lhey  can  r.erve  as  memory  aids.  They  can 
he  step-hy-step,  how-to-do-it  directions.  In  this  paper,  1  am  only 
addressing  user  guides  that  are  step-hy-step  directions  intended  1 1>  tell 
a  person  how  to  perform  a  task  skillfully,  examples  of  such  user 
guides:  how  to  repair  an  engine,  how  to  fly  an  airplane,  how  to  cook 
an  omelette,  how  to  monitor  a  contract,  how  to  solve  problems.  1  an; 
not  going  to  deal  v.ith  user  guides  that  try  to  improve  skills  by 
providing  exercises  (e.g.,  cites;;  problems  to  solve),  or  tty  suggesting 
other  forms  of  instruction.  1  am  only  concerned  with  attempts  to  break 
a  skill  down  into  its  components,  and  then  to  present  these  components  as 
steps  to  he  followed. 

Often,  psychologists,  educators,  engineers,  and  human  factors 
specialists  are  called  upon  to  prepare  explicit  user  guides.  Many 
times,  a  conflict  will  arise  about  how  specific  to  make  t hr  guide. 

The  people  representing  the  users  may  argue  that  a  very  specific  guide 
is  needed,  so  the  user  will  know  just  what  to  do,  and  when.  Anything 
less  may  be  too  vague  to  be  useful.  The  people  charged  with  developing 
the  guide  will  argue  against  such  a  cookbook  approach.  They  may  claim 
that  the  specifies  are  not  known.  Sometimes,  t  licv  will  propose  a 


multi-year  program  of  research  to  gather  the  data.  lhe  users  may 
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suspect  t  hi  develi  ;>r:  of  la.- me:  ,  incompel  ence  ,  and  willful  noncomp  1  i  aiu  e  . 
the  developers  may  sir  pci  t  flu*  u:  its  ol  being  unreasonable,  naive, 
and  rigid.  liathei  than  choose  ..ides  (hut,  it  may  hi*  helpful  to  examine 
some  ol  the  bi . imptii  .ns  beh  ind  user  guides . 

liner  guides  (i.e.,  step-by-step  descriptions)  rest  upon  the 
ar.su  pt  ions  tti.it  a'  the  skilled  perf  ormaneo  of  a  l  ask  can  lie  analyzed 
into  proee.lure; ,  and  (h)  the.se  proeedures  can  he  presented  in  a  guide¬ 
book  to  he  followed.  Are  either  ol  these  reasonable  assumptions? 
fan  perlormanee  tie  h rot- on  up  into  voluntary  at  t  ions?  Hie  task  of  preparing 
user  (|in  tes  raiser  issuer  that  are  fundamental  to  psycho lng\  and 
ptii  In:  ophy  .  for  we  begin  to  ark  questions,  about  the  nature  of  knowledge, 
and  whether  the  knowledge  underlying  skilled  performance  can  be  expressed 
in  t  erms.  of  procedures. 

This  paper  is  organized  into  two  sections.,  t  irst  ,  1  will  explain 
wliy  some  aspeets.  of  perf  ornianee  cannot  be  analyzed  into  procedures. 

Second,  I  will  explore  some  of  the  barriers  this  creates  for  step-by- 
step  typer  of  user  guide.. 

1.  fan  skilled  performance  tie  specified  as  procedures? 

Weitzenfeld  (l°7a''  lias  argued  that  wtiile  all  knowledge  is 
analy/ahle  into  is sert  ions  that  are  true  or  false,  the  application  of  these 
assert  ions  pre  oppose :  the  ahi lily  to  recognize  instances  when  they  are 
called  for.  And  this  ability,  which  Weitzenfeld  calls  a  recognit ional 
capacity,  cannot  he  specified  in  terms  of  procedures  to  he  followed. 

When  a  task  is  presented  as.  a  set  of  rules  or  procedures 
to  be  followed,  tlie  problem  is  that  novices  do  not  recognize  when  to 

^Statements  of  the  form  "if  \  occurs,  do  ^  in  order  to  produce  7." 
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apply  these  procedures;  they  are  insens  i  t  ivc  to  ttie  experiential/ 
contextual  factor:;  governing  select  ion/appl  icat  iun/inodi  t i  cat  urn  of 
procedure:; . 

Now,  everything  would  work  out  if  we  could  tell  the  novice 
when  to  apply  the  procedures-- if  we  could  give  higher-level  procedures 
to  guide  the  application  of  the  lower-level  ones.  But  1  don't  think  we 
can.  lo  see  why ,  let's  consider  a  chess  example,  let's  say  a  grandmaster 
writes  a  book  of  chess  principles,  and  one  of  them  is  to  keep  the  king 
protected,  line,  that's  good  to  know,  if  I  am  a  novice.  But  if  I  am 
playing  at  a  reasonably  proficient  level  of  performance,  then  the  guidance 
isn't  enough.  1  need  to  recognize  when  and  how  it  applies.  It  makes 
sense  to  keep  my  king  protected  in  the  middle  of  the  game,  hut  in  the  end 
game  I  may  want  my  king  out  there  helping  my  pawns  race  down  the  board, 
and  intercepting  my  opponent's  pawns.  1  also  have  to  know  how  to  apply 
the  principle — how  to  keep  my  king  protected,  for  the  novice,  this 
usually  means  keeping  as  many  friendly  pieces  in  front  of  the  king  as 
possible,  an  approach  that  has  all  the  subtlety  and  finesse  of  trench 
warfare  during  WWI.  As  we  gain  in  proficiency,  we  recognize  t ti.it 
"protect"  involves  keeping  the  king  secure  from  the  various  combinations 
and  sacrifice  attacks  available  to  our  opponent. 

Now,  the  question  is:  can  wc  take  this  ability  of  the 
proficient  chess  player  to  recognize  when  and  how  to  protect  the  king, 
and  translate  it  into  higher-level  procedures  for  the  novice?  I  don't 
think  so.  One  reason  is  that  if  I  can  be  told  when  and  how  to  protect 
my  king,  then  the  principle:  "Protect  your  king,"  becomes  trivial.  I 
shouldn't  have  to  worry  about  it  anymore.  If  I  can  recognize  when  my 
king  is  and  isn't  protected,  then  I  don't  need  the  principle  "Protect 
your  king."  The  second  reason  is  that  the  grandmaster's  skill  in 


recocjni/ing  when  and  how  to  protect  the  king  is  more  like  a 


perceptual  recognition  than  a  higher-order  procedure.  It  reflects 
training,  experience  and  contextual  factors,  and  the  ability  to  perceive 
a  new  situation  as  similar  to  ones  already  understood  (t>rcyfus,  1972; 
Weitzenteld,  1974;  Klein,  1977,  1970). 

So,  guidebooks  are  useful  for  teaching  a  complete  novice  some 
easily  applied,  non-context ual  principle:;  of  chess,  but  they  are  of  less 
value  for  teaching  high  level  chess ,  where  skill  depends  on  recognitions! 
capacity  rather  than  on  procedures  to  be  followed.  That  is  why  for  a 
given  position,  a  grandmaster  considers  only  about  two-to-four  moves, 
wherea:  most  top-level  computers  consider  over  30  moves.  The  skill  of 
the  grandmaster  is  in  recognizing  which  moves  to  analyze.  Computer 
programs  must  resort  to  brute  force  to  do  what  the  grandmaster  does  in 
"zeroing  in"  to  promising  move;;.  Interestingly,  while  beginners 
study  hooks  of  principles  and  find  them  helpful,  masters  study  actual 
games. 

I  am  not  saying  that  there  are  no  procedures  to  give  to  the 
novice.  There  arc,  and  they  can  be  very  helpful  for  a  variety  of  tasks. 

I  am  attacking  the  assumption  that  all  tasks  can  be  described  in  terms 
of  steps  to  be  followed,  and  that  novices  are  performing  these  steps 
slowly  arid  inaccurately  whereas  experts  are  performing  the  same  steps 
quickly  and  accurately.  1  am  instead  claiming  that  some  aspects  of 
skilled  performance,  i.e.,  rccognit ional  capacity,  cannot  be  described  in 
terms  of  steps  that  can  be  followed,  but  depend  on  training  and  experience. 
The  skill  of  a  proficient  performer  does  not  break  down  into  procedures, 
and  so  step-by-step  guidebooks  won't  be  able  to  teach  skilled  performance. 
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Skill  also  involves  <i  f  ami liarity  with  our  own  abilities,  gained 
through  i  \|«‘i  niiu'.  When  you  attempt  1 1.  subtitutc  higher-order 
procedures  foi  r»  cogn i  zed  self-eapai  ity ,  you  i  tin  into  problems  of 
circularity.  lh.it  is  because  you  arc  L  r  >  i  r  u  j  to  present  guidance  to 
a  novice  about  how  to  perforin  a  task,  but  the  guidance  could  only  tie 
undersl  •  1  by  who  is  no  longer  a  i iov ici  . 

For  an  example  of  this,  think  about  what  kind  of  guidance  you  would 
give  a  novice  driver,  who  vms  having  trouble  making  left  turns  into 
ising  traffic.  this  is  a  real  pi  I  .  I  i  .  in  part 

I  i  -  theii  turns  are  slow,  and  in  part  t  th  y  are  variable. 

One*  turn  may  take  ?  second:,,  and  another  If  refunds  as  they  misjudge 
tta.  angle,  k  and  forth,  backup,  and  recover. 

In  pi  nt  gui  I  nee ,  in  1 1 •>  foi  ot  stej  by  '  ■  j >  procedures, 
we  might  evolve  a  flowchart  such  a:  Figure  I .  But  then  are  several 
problems  with  this.  First  -  how  is  the  novice  going  to  estimate  (A), 
which  involves  estimating  distances  and  speeds  of  cars  and  translating 
tliem  into  seconds  available?  Second  -  what  value  will  the  novice  use 
for  (B)  -  number  of  seconds  needed?  If  novices  use  the  number  of 
seconds  needed  by  an  experienced  driver,  they  are  going  to  get  hit  a 
lot.  If  they  use  the  number  of  seconds  it  takes  then  on  90pj  of  their 
turns,  then  you  are  just  ratifying  what  they  usually  do,  not  giving 
them  guidance  for  improving  their  performance.  And  third,  if  people 
could  estimate  (A)  and  (B),  they  wouldn't  be  novices.  Novices  are 
people  wtio  don't  know  how  well  or  accurately  they  will  perform.  People 
who  can  perform  these  estimates  don't  need  t tic*  guidance.  The  circularity 
is  introduced  when  you  try  to  replace  experience  and  recognition  with 
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procedure:;  th.it  still  presuppose  recognition. 

So,  in  response  to  the  question  "Can  skilled  performance  be  specified 
in  terms  of  procedures?"  the  answer  appears  to  be  "no. "  All  ta  ■  epend 
on  recognitional  capacity ,  and  this  i  built  up  through  experience.  Then 
are  ways  of  training  it,  but  not  of  replacing  it  by  procedures. 

II.  Barriers  to  Guidance 

If  knowledge  of  how  to  perform  a  task  cannot,  be  decomposed  (into  steps, 
rules,  sub-tasks,  procedures),  then  we  hove  identified  a  barrier  to  user 
guides.  (For  a  fuller  treatment  of  many  of  the  points  discussed  below,  see 
Klein,  1977,  1978) .  With  regard  to  step-by-step  user  guides,  the  theoretical 
limitation  described  in  the  last  section  should  be  manifested  in  two  ways: 

(a)  a  restriction  on  the  tasks  that  can  be  described,  (b)  limitation  of 
audience  to  novice  levels  of  proficiency. 

(a)  Restriction  cn  the  tasks  that  can  be  described.  Tasks 
vary  in  the  extent  to  which  they  rely  on  recognitional  capacity,  for 
some  tasks,  recognitional  requirements  are  simple;  for  others,  they  are 
complex  and  rely  heavily  on  contextual  factors.  Step-by-step  descriptions 
work  for  tasks  that  are  largely  procedural,  such  as  starting  a  jet  engine.  The 
switch  movements  are  reasonably  straightforward,  and  the  contextual  framework 
is  limited,  so  recognitional  capacities  are  not  very  important.  The  airplane 
is  sitting  on  the  ground,  in  as  standardized  a  condition  as  it  will  ever  be. 
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I  am  not  claiming  the  proficient  drivers  follow  the  procedures  in  Figure  1  - 
quite  the  reverse.  The  experienced  driver  isn't  following  any  procedures. 

Can  you  estimate  the  values  for  (A)  and  (B)?  I  doubt  it.  Yet  you  have  no 
trouble  recognizing  when  a  suitable  gap  exists  for  turning  left.  It  could  be 
argued  that  the  rules  are  so  well  learned  that  they  have  become  unconscious 
and  automatic.  But  then  why  would  people  have  trouble  calculating  and  using 
the  values  on  a  conscious  level,  and  why  would  their  conscious  use  interfere 
with  performance?  And  how  do  we  tell  the  novice  about  rules  and  procedures 
that  should  only  be  used  unconsciously? 


The  tasks  that  will  not  bo  successfully  described  in  terms  of 
step-by-step  procedures  are  those  for  which  skilled  performance  depends  on 
complex  recognitional  capacity.  Examples  of  such  tasks  are:  making 
a  decision,  catching  a  ball,  maneuvering  against  an  opponent.  V/hen  we  try 
to  proceduralize  such  tasks,  we  often  wind  up  with  steps  that  don't  mean 
anything.  Montemerlo  and  Harris  (1978)  have  presented  a  facetious  example 
of  procedures  that  have  to  be  followed  in  painting  masterpieces:  1)  think 
of  a  great  idea;  2)  Sketch  it  out;  3)  fill  in  the  colors  and  details; 

A)  Check  it  over  and  make  any  necessary  alterations. 

Contextual  understanding  allows  experts  to  resolve  ambiguity.  But 
guidebooks  cannot  afford  to  assume  that  their  users  have  an  adequate 
contextual  understanding  (if  the  users  did,  they  would  not  need  the  guide¬ 
books).  So  ambiguity  is  resolved  through  more  rules  and  procedures.  But 
context  is  not  just  more  rules  or  pieces  of  information.  It  is  the  framework 
within  which  the  task  is  performed,  and  within  which  it  must  be  understood. 

A  practical  barrier  that  is  encountered  in  trying  to  handle  contextual 
frameworks  by  additional  rules  and  procedures,  is  the  need  for  voluminous 
amounts  of  information  which  are  still  deemed  insufficient.  A  burden 
this  creates  for  guidebooks  is  that  of  presenting  and  cross-referencing 
additional  information. 

A  concrete  example  is  the  guidance  provided  for  Instructional 
Systems  Development  (ISO)  personnel.  ISD  is  a  task  analysis  of  how  to  do 
task  analysis.  It  presents  the  steps  needed  to  break  complex  tasks  down  into 
steps.  Montemerlo  and  Harris  (1978)  have  documented  the  growth  of 
ISD  manuals  from  fair-sized  single  volumes  in  the  late  '60s  to  the  massive 
multi-volume  models  of  the  mid-' 70s.  But  no  one  can  apply  massive 
multi-volume  models  (which  are  still  criticized  as  having  insufficient 
detail).  According  to  Montemerlo  and  Harris,  ISD  is  a  "judgemental"  task 
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(i.e.,  depot  ulent  un  recoi|i  1 1 1  i  hi  la  1  capacities)  and  thus  not  amenah  tc  to  it 
own  methods  ol  1  lists  analysis. 

(t>)  I  uuit.it  ion  ol  audience  to  novice  levels  ol  plot  leiencv. 

It  is  liai'il  to  describe  tlio  procedures  soiiiooni'  must  follow  to  become 
proficient  at  a  task,  because  pnil  icient  performers  aro  not  aware  ol 
tollowini|  procedures ;  attempts  to  make  them  follow  proi  eiliiies  can 
interfere  with  their  perl  ormanee . 

Proficiency  seems  to  ilepeiul  on  I  orcjet  t  inq  ihont  rules  aiut  advice, 
sueh  as  the  procedures  presented  in  step  tn  step  ijmdehooks.  11  \  on 
had  to  estimate  vA)  aiul  (H)  in  I  n)iire  1,  would  that  help  or  interfere 
with  makirui  left  turns1  A  person  pis  ini)  a  piano  reeital  who  is  thinkiiu) 
atuiut  a  hook  "Piano  Playiiiij  Made  Simple,"  is  in  trouble. 

I  have  been  aniuini)  that  proficient  pert  ormanee  doesn't  consist 
of  follow  ini)  procedures.  the  reverse  is  also  true:  Procedural  tasks 
do  not  seem  to  lend  themselves  to  hiijhty  proficient  levels  ot  performance, 
ton  would  not  su\  that  someone  was  a  real  expert  at  start  uni  a  ear 
under  standard  conditions.,  ill  course,  it  we  arc  tulkinu  about  \ our  car, 
and  i|ettmi|  it  started  on  cold  winter  mornini|s,  when  you  have  to  listen 
to  its  ijasps  and  s|iutters  and  know  just  how  much  to  tease  it  with  the 
choke  or  accelerator,  then  we  are  dealini]  with  complex  reeoi|nit  ional 
capacitv,  and  expert  ic.e  is  possible. 

t  have  implied  in  this  section  that  in  order  to  determine 
whether  a  procedural  description  of  performance  (such  as  ISP  or 
Job  Performance  Aiil  (JPA)  approaches.)  will  be  useful,  we  must  consider  two 
dimensions.  lhc  I  irst  is  whether  the  task  is  procedural  (rci|tiirini|  simple 
reeoi)n  i  t  iona  1  capacities),  or  whether  it  depends  on  complex  reeoiin  1 1  iona  1 
capacities.  (Ibis,  also  has  implications  t  or  the  amount  of  int  urination 
to  be  presented.)  Iho  second  dimension  concerns  the  tarpet  population:  an 


we  trying  to  improve  the  performance  of  novice:;,  so  they  can  achieve  a 
low  level  of  competence  under  standard  conditions,  or  are  we  trying  to  tie 
adequate  performers  become  highly  proficient? 

lasks  that  are  procedural  (i.e.,  insensitive  to  contextual 
variations)  and  require  novices  to  become  minimally  adequate  will  be 
most  easily  and  successfully  handled  by  user  guides. 

111.  rone lus ions 

User  guides  are  often  attempts  to  provide  cookbook  (i.e., 
procedural)  approaches  to  performance.  Cookbook  approaches  don't  work 
in  statistics  --  they  teach  the  procedures  for  calculating  a  formula, 
hut  leave  the  student  baft  led  about  when  to  apply  the  formula.  Cookbook 
approaches  do  not  work  for  teaching  deduct  ive  logic.  Students  learn  tiow 
to  set  up  a  Venn  diagram,  hut  don't  know  how  to  apply  this  in  a  new 
situation  (unless  they  can  recognize  that  it  is  like  a  specific  problem 
they  have  already  done).  Cookbook  approaches  don't  work  very  well  in 
cooking  either.  They  can  help  a  novice  make  a  reasonable  approximation 
of  a  dish.  But  their  value  to  the  proficient  chef  is  as  a  checklist 
reminder  about  ingredients  and  operations.  The  operations  presuppose 
recognit ional  capacities,  and  for  this  reason  are  beyond  the  skill  of 
nov i ccs . 

I  am  proposing  that  disagreements  between  users  and  developers 
of  guides  can  be  resolved  by  a  more  careful  analysis  of  t he  nature  oT 
tasks  involved,  the  type  of  audience,  and  the  level  of  skill  development 
expect ed . 

Sir  Peter  Medawar  has  stated  that  "To  deride  the  hope  of  progress 
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is  the  ultimate  fatuity,  the  last  word  in  poverty  of  spirit  and  meanness 
of  mind."  I  am  arguing  that  current  task  analysis  approaches  will  be 
unsuccessful  except  when  dealing  with  procedural  tasks  and  novice  levels 
of  proficiency.  I  hope  that  this  does  not  represent  poverty  of  spirit 
and  meanness  of  mind.  1  feel  that  it  is  important  to  recognize  limitations 
of  paradigms  in  advance  of  their  demonstrated  failures,  so  that 
alternate  approaches  can  be  developed. 

One  potential  strategy  in  developing  an  alternate  approach 
would  be  to  focus  on  the  nature  of  "recognitional  capacity."  I  have 
not  defined  recognitional  capacity  except  to  say  that  it  is  presupposed 
by  procedural  types  of  knowledge,  and  that  it  can  not  be  replaced  by 
higher-level  procedures.  Recognizing  when  a  procedure  applies  in  a 
new  situation  may  sometimes  involve  recognizing  that  the  new  situation 
is  similar  to  some  previous  situation,  especially  in  complex  situations. 
This  recognition  of  similarity  may  be  useful  for  directing  performance. 

Ihe  selection  and  use  of  previous  situations  to  direct  performance  in 
new  situations,  is  the  phenomenon  of  reasoning  by  analogy.  Thus, 
it  may  be  possible  to  extend  some  current  work  on  analogical  inference 
(e.g.,  Weitzenfeld  &  Klein,  1979)  to  provide  principles  of  guidance 
for  the  learning  of  complex  tasks.  (Hut  it  should  not  be  possible  to 
devise  step-by-step  analogical  procedures.) 
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